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Abstract. For | < a < 1, we propose the MDP analysis for family 

1 n 

i=l 

where (X n ) n >o be a homogeneous ergodic Markov chain, X n £ R d , 
when the spectrum of operator P x is continuous. The vector-valued 
function H is not assumed to be bounded but the Lipschitz continuity 
of H is required. The main helpful tools in our approach are Poisson 
equation and Stochastic Exponential; the first enables to replace the 
original family by -^M n with a martingale M n while the second to 
avoid the direct Laplace transform analysis. 



1. Introduction and discussion 

Let (X n ) n >o be a homogeneous ergodic Markov chain, X n S M. d with the 
transition probability kernel for n steps: P^ = p( n \x,dy) (for brevity 
.pj 1 ^ := P x ) and the unique invariant measure [i. 

Let H be a measurable function M — ► MP with J Rd \H(z)\fx(dz) < oo and 



/ 



H(z)fi(dz) = 0. (1.1) 
Set 

1 n 

i=l 

In this paper, we examine the moderate deviation principle (MDP) for 
families (5") n >i when the spectrum of operator P x is continuous. 

It is well known that for bounded H satisfying l|l.l|) ( (H) - condition) , the 
most MDP compatible Markov chains are characterized by eigenvalues gap 
condition (EG) (see Wu, ^Hl; [T7j . Gong and Wu, [7j, and citations therein): 

the unit is an isolated, simple and the only eigenvalue with 
modulus 1 of the transition probability kernel P x . 

In the framework of (H)-(EG) conditions, the MDP is valid with the rate of 
speed n~( 2a_1 ) and the rate function I(y),y G M. d 

J(y)= Al«e, B*By = v 
cxo, otherwise, 
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where B® is the pseudoinverse matrix (in Moore-Penrose sense, see e.g.p^) 
for the matrix 



B = f H(x)H*(x)n(dx) 

JM. d 



n>l 



H(x)(P^H)* + (pV*H)H*(xj\ fi(dx) (1.3) 



(henceforth, *, | • |, and || • \\q are the transposition symbol, L 1 norm and L 2 
norm with the kernel Q (||x||q = (x, Qx)) respectively). 

Owing to the quadratic form rate function, the MDP is an attractive tool 
for an asymptotic analysis in many areas, say, with thesis 

"MDP instead of CLT" 

In this paper, we intend to apply the MDP analysis to Markov chain 
defined by the recurrent equation 

X n = f(X n -i,£ n ), n > 1 

generated by i.i.d. sequence (£ n )n>i of random vectors, where / is some 
vector-valued measurable function. Obviously, the function / and the dis- 
tribution of £i might be specified in this way P x satisfies (EG). For instance, 
if d = 1 and 

X n = f(X n _i) + £ n , 

then for bounded / and Laplacian random variable £i (EG) holds. How- 
ever, (EG) fails for many useful in applications ergodic Markov chains. For 
d = 1, a typical example is Gaussian Markov chain defined by the linear 
recurrent equation governed by i.i.d. sequence of (0, 1)-Gaussian random 
variables (here \a\ < 1) 

X n = aX n _i + £ n . 

In this paper, we avoid a verification of (EG). Although our approach is 
close to conceptions of "Multiplicative Ergodicity" (see Balaji and Myen |2j) 
and "Geometrical Ergodicity" (see Kontoyiannis and Meyn, [S] and Meyn 
and Tweedie, ^J), Chen and Guillin, [1]) we do not follow explicitly these 
methodologies. 

Our main tools are the Poisson equation and the Puhalskii theorem from 
|15j . The Poisson equation permits to reduce the MDP verification for 
(S£)„>i to (^M„) n >i, where M n is a martingale generated by Markov 
chain, while the Puhalskii theorem allows to replace an asymptotic analysis 
for the Laplace transform of -^M n by the asymptotic analysis for, so called, 
Stochastic Exponential 



1 

^ n (A)=JJ^(exp[(A,— (Mi-Mi_i))] Xi-i), \£R d (1.4) 

i=l 

being the product of the conditional Laplace transforms for martingale in- 
crements. 

An effectiveness of the Poisson equation approach (method of corrector) 
combined with the stochastic exponential is well known from the proofs 
of functional central limit theorem (FCLT) for the family (S^' 5 ) n >i (see, 
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e.g. Papanicolaou, Stroock and Varadhan ^21 > Ethier and Kurtz [Jj], Bhat- 
tacharya Pardoux and Veretennikov and with 0.5 < a < 1 for the 
MDP analysis for the continuous time case (see e.g. [§], [TU] K 

2. Formulation of main result 

We consider Markov chain (X n ) n >o, X n £ M. d defined by a nonlinear 
recurrent equation 

X n = f{X n -i,i n ), (2.1) 
where / = f(z,v) is a vector function with entries fi(z, v), . . . , fd(z, v), 
u € K d , v € M p and (£ n )n>i is i-i.d. sequence of random vectors of the size 
p. 

We fix the following assumptions. 

Assumption 2.1. Entries of f are Lipschitz continuous functions in the 
following sense: 

\fi(zi . . .,Zj-!, Zj,Z j+ x ...,Z d ,V!,.. .,V p ) 

- fi(zx . . . , Zj-!, Zj , Z j+ l ...,Z d ,Vi,.. .,V p )\ 
— Qij I Zj Zj I , 

\f(z,v')-f(z,v")\<Q\v'- V "\, 

where 

max Qij = q < 1. 

Assumption 2.2. For sufficiently small positive 5, 

Ee s ^\ < oo. 

Theorem 2.1. Under Assumvtions \2.1\ and \2. 6 A the Markov chain is ergodic 
with the invariant measure fi such that f Rd \z\fj,(dz) < oo. For any Lipschitz 
continuous function H with f Rd H(z)n(dz) = 0, the family (S^) n >i obeys 
the MDP in the metric space (M. d ,r) (r is the Euclidean metric) with the 
rate of speed n~^ 2a ~ 1 ^ and the rate function given in (|1.2|) . 

Remark 1. The assumptions of Theorem \2.1\ do not guarantee (EG). The 
function H satisfies the linear growth condition. Moreover, an existence of 
the continuous component of ^-distribution, as in is not to be assumed. 

Consider now a linear recurrent equation 

X n = AX n _i + £ n 

governed by i.i.d. sequence (£ n ) n >i of random vectors, where A is matrix of 
the size d x d and entries A™ . Now, Assumption l2.1l reads as: maxi,-|Ay| < 1. 
This assumption is very restrictive and we replace it by more natural one 

Assumption 2.3. The eigenvalues of A lie within the unit circle. 
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Theorem 2.2. Under Assumption \2.'A the Markov chain is ergodic with 
the invariant measure fi such that J Rd \\z\\ 2 fi(dz) < oo. For any Lipschitz 
continuous function H with J^ d H(z)fj,(dz) < oo, the family (S^) n >i obeys 
the MDP in the metric space (K d ,r) with the rate of speed n~^ 2a ^ and the 
rate function given in Q1.2JI . 

3. Preliminaries 

3.1. (EG)-(H) conditions. To clarify our approach to the MDP analysis, 
let us demonstrate its application for (EG)-(H) setting. 

The (EG) condition provides the geometric ergodicity of P^ to the in- 
variant measure \x in the total variation norm: there exist constants K > 
and q G (0, 1) such that for any x G M. d 

\\Pt } ~ Mlltv < Kg n , n>l. 
So, (EG)-(H) conditions provide the existence of bounded function 

U(x) = H(x) + ^P^H (3.1) 

n>l 

which solves the Poisson equation 

H(x) = H{x) + P X U. (3.2) 

In view of the Markov property, Q := U (Xi) — Px t -i U, i > 1 is the sequence 
of bounded martingale-differences with respect to the filtration generated 
by Markov chain. Hence, M n = Y27=i Ci i s the martingale with bounded 
increments. With the help of Poisson's equation we get the following de- 
composition 

n 

V H(Xi-x) = U(x) - U(X n ) +M n . (3.3) 

* — ^ corrector 

Owing to the boundedness of U, the families S% and ^aM n share the same 
MDP. This fact enables us to verify the MDP for (^M n ) n >i. 

Assume for a moment that £j's are also are independent and identically 
distributed random vectors. Recall that EQi = and denote B = E£\Q. 
Introduce the Laplace transform for ^M„: 

S n (\) = (Ee^&Y, A G M d . (3.4) 

It is well known that the MDP for -\M n is provided by the following con- 
ditions: B is not singular matrix and 

lim n 2a ~ l log SJX] = -(A, BX), A G R d . 

n— >oo 2 

The framework of this proof might be adapted to the case considered in 
the paper. Instead of B, we introduce the conditional covariance matrix 
E(QQ\Xi-i) and, instead of the Laplace transform (|3.4|) . the stochastic 
exponential (|1,4[) . having a form 

n 



<? n (\) = l[E(e^\X l _ l ), AG 
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which is not the Laplace transform itself. The homogeneity of Markov chain 
and the definition of Q provide E(QQ\Xi-i) = for the matrix- 

valued function 

B(x) = P X UU* - P X U{P X U)*. (3.5) 

The Poisson equation ()3.2jl and its solution 1)3.1)1 allow to transform 1)3. 5 Jl 
into 

B(x) = H(x)H*{x) + ]T [H(x)(P^Hy + (P^H)H* 



n>l 



that is for B defined in ()1.3)l 



f B(z)fi(dz) = B. 



Now, we are in the position to formulate 
Puhalskii Theorem. Assume B from 1)1.3)) is nonsingular matrix and for 
any e > 0, AG R d 



lim 

n— >oo n 



1 



2ct- 



T logP 



??■ 



2a- 1 



1 



log4i(A) — -(X,BX) 



> e 



-oo. 



(3.6) 



Then, the family ^M n , n > 1 possesses the MDP in the metric space 
, r) (r is £/ie Euclidean metric) with the rate of speed n - ^ 2 " -1 ^ and rate 
function I(y) = 

Remark 2. T/ie condition ()3.6)) is provided by 



lim ^lo g p(I|^(A, [j3(Xi_i)-B]A 

8=1 

l im _^l og pf^_y^[| C .|3 e n-|Ci|| X 



-oo 



(3.7) 



> e 



-oo. 



The second condition in 1)3.7)1 is implied by the boundedness of |Ci|' s - The 
first part in 1)3.7)1 is known as Dembo's conditions, [5], formulated as follows: 
for any e > 0, A £ M d 



i 1 i n 

EE -logP(- V(a, [B(Xi_i)-J3]A 



i=i 



> e < 0. 



In order to verify the first condition in 1)3.7)1 , we will follow to the framework 
of Poisson's equation technique. We introduce the function 



which is bounded and 



h(x) = (A, [B(x) - B]X) 



h(z)fi(dz) = 0. 



Then the function u(x) = h{x) + Xm>i Pxh is weu defined and solves the 
Poisson equation u(x) = h{x) + P x u. Similarly to ()3.3|) . we have 



1 " 



n(x) - u(X n ) mn 
n n 
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where m n = Ym=\ z i ls the martingale with bounded martingale-differences 
(zi)i>i- Since u is bounded, the first condition in 1)3 . 7 j) is reduced to 

1 



lim 



n— >oo n 



2a-l 



logP(|m n | > tie) = — oo 



(3.8) 



while (|3.8j) is provided by Theorem lA.il in Appendix which states that (|3.8jl 
holds for any martingale with bounded increments. 

3.1.1. Singular B. Though to the conditions from 1)3. 7 Jl remain to hold when 
B is singular, the Puhalskii theorem is no longer valid. Nevertheless, we shall 
use this theorem as an auxiliary tool. 

It is well known that the family ^g-, n > 1 obeys the MDP with the rate 
of speed n~^ 2a_1 ^ and the rate function given in 1)1.2)1 provided that 



lim lim 

C— >oon— >oo n 



1 



2a-l ■ 



Mr, 



lim lim 



1 



*0 n— >oo n 



lim lim 



2a-l 
1 



>0 n— >oo fl 



2a-l 



P 



P 



n u 

Mn 

n a 

Mn 

n a 



> C 



-oo 



<e < 



<e)> 



-m- 



(3.9) 



The first condition in ()3.9|) provides the exponential tightness in the metric 
r while the next others the local MDP. 

In order to verify of ()3.9|) , we introduce "regularized" family , n > 1 
with 



M% = M n + y/pJ2ei 



where j3 is a positive parameter and (#j)i>i is a sequence of zero mean i.i.d. 
Gaussian random vectors with cov(#i,#i) =: I (I is the unite matrix). The 
Markov chain and (#j)i>i are assumed to be independent objects. 

It is clear that for this setting the matrix B is transformed into the positive 
definite matrix Bp = B + (31. Now, the Puhalskii theorem is applicable and 
guarantees the MDP with the same rate of speed and the rate function 



2\\y\\ B - 1 - 



As the corollary of the MDP, ^S~,n > 1 is exponentially 



tight (see [II]) and obeys the local MDP: 

1 



lim lim 

C— >oo n— >oo n 



2a- 1 



P 



Mn 



lim lim 
lim lim 



1 



2a-l 
1 



,2a-l 



P 



P 



n" 

Mi 
n a 

Mn_ 

n a 



> C 



-oo 



<e < 



<s > 



e—>0 n^oo n> 

Notice now that (|3.9|) is implied by (|3.1()|l provided that 



(3.10) 



2 ll^lls®' 
CXO, 



B®By = y 
otherwise 



(3.11) 
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V 



and 



lim lim — k — T P 

/3-.On-»oo n la ~ v 



\\>v)=-oo, Vr ? >0. (3.12) 



n u 
i=i 



Let T be the orthogonal matrix transforming B to the diagonal form: 
diag(S) = T*BT. Then, owing to 

2I p (y) = y*(J3I + B)-^ = y*T((3I + diag^))- 1 ^, 

for y = B®By we have (recall that B®BB® = B® , see [T]) 

2I p (y) = y*B®BT(pI + diag(5))- 1 T*y 

= y*B®TT*BT(/3I + diag( J B))~ 1 T*y 

= y*B®Tdiag(B)((3I + diag(S))^ 1 T*y 

y*5 e T diag(£)diag(5)T*y 

= y*B®Tdiag(5)T*Tdiag(5)T*y 

= y*B (B BB (B u = u*£?®y = \\y\\ 2 m = 2I(y). 

If y ^ £®5y, lim^o 2I/?(?/) = oo. 
Thus, SZTfy holds true. 

Since (#i)i>i is i.i.d. sequence of random vectors and entries of £i are 
i.i.d. (0, 1)-Gaussian random variables, the verification of (|3.12j) is reduced 
to 



lim lim — = — T log P ( > > — ;= 



r logi>( J> >-^)=-oo, (3.13) 



where ($i)«>i is a sequence of i.i.d. (0, 1)-Gaussian random variables. It is 
clear that 1)3.13(1 is equivalent to 



lim lim — - log P ( ± #j > — ^ ) = 

i=l 

and, moreover, it suffices to establish "+" only. 

By the Chernoff inequality with A > 0, we find that 

^/v^^ n a ri, / n a ri A 2 

P(g 9 ,>- 7 |)< e xp(-A- 7 | + „ T 

while the choice of A = provides 

"VP 



-oo 



1"- rv / 

— = — - log P > r? 7 - > — ==■ < > — oo. 



3.2. Virtual scenario. 

- (EG)-(H) are not assumed 

- the ergodicity of Markov is checked 

- H is chosen to hold (|1.1|) . 
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(1) We assume (j3.1|) . Then the function U solves the Poisson equation 
and the decomposition from ()3.3j) is valid with M n = Y17=l Cii where Q = 
u(Xi) — Px l ^ 1 u. We assume that 



E(*(i < const. 



E 



\Q 



< const. 



(2) With B(x) and B are defined in (|3.5|) and ljl.3j) respectively, set 
h(x) = (A, [B(x) - B]\), A £ R d . 



We assume that 

(i) u(x) = h{x) + 53n>i Px h is well defined 

(ii) for Zi = u(Xi) - Px^u, 

Eza < const. 



E 



< const. 



(3) We assume that for any e > 

hm ^L_\ og P(\U(X n )\ > n a e) = -oo 
lim i logP(mX n )| > n a e) = -oo. 

Notice that (EG)-(H) provide (l)-(3) and even if (EG)-(H) fail, (l)-(3) 
may fulfill. Moreover, (l)-(3) guarantee the validity for all steps of the 
proof given in Section 13.11 so that if the ergodic property of Markov chain 
hold, (l)-(3) provides the MDP. 

We use this scenario for the proofs of Theorems 12.11 and 12.21 



4. The proof of Theorem 12. II 
Here, we follow the virtual scenario from Section f3. 21 

4.1. Ergodic property. 

Lemma 4.1. Under Assumption Q£ 11 {X n ) n >o possesses the unique proba- 
bility invariant measure fi with J Rd \z\(i(dz) < oo. 

Proof. Let us initialize the recursion given in (|2.1j) by a random vector 
Xq, independent of (£ n )n>i 5 with the distribution function v such that 
f Rd \x\i , (dx) < oo and denote fj, n (dz) = L d P^ ri \dz)v{dx). We show that 
the family {ji n ) n >\ is tight in the Levy-Prohorov metric: 

lim lim fJ. n (\z\ > k) = 0. 
k— too n— >oc 

Since by the Chebyshev inequality /i n (|z| > k) < E ^™^ ; it suffices to show 
that 

supE\X n \ < oo. (4.1) 

n>l 
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By Assumption l2.il we have 

\X n \ = |/(0, Cn) + (/(*»-!,£„) - /(0,Cn))| 

< |/(0,£n)| + |/(*»-l,£»)-/(0,£n))| 

< |/(0,e«)| + ff|X n _i| 

< |/(0,0)| +^ n |+^|X n _ 1 |. 

Hence, < |/(0,0)| + £E\^\ + gE\X n „i\. Since E\X Q \ < oo, we have 

£7|X n | < oo and, moreover, 

ElXnl < ElXol+ \mm±mA , „>,, (4 . 2) 

1 - Q 

i.e. (|4.1j) holds true. 

Further, by the Prohorov theorem, the sequence of /x n , n f oo, contains 
further subsequence /i n , n' /* oo converging in the Levy-Prohorov metric 
to a limit fi being the probability measure on W d . In other words, for any 
bounded and continuous function g 

lim / g(z)fi n '{dz) = / g{z)fi{dz). 

With L > 0, taking g(z) = L A \z\, we obtain 

/ (LA |z|)M<iz) = lim E(L A |X n /|) < lim E\X n \ < const. 

Jjgd n'—>oo n^oo 

(see (|4.2f) ). Then, by the monotone convergence theorem, it holds that 

/ \z\[i{dz) < lim -ElX^ < oo. 

Now, we show that [i is an invariant measure of the Markov chain, that 
is for any nonnegative, bounded and measurable function g 

g{x)\i{dx) = \ P x g/i(dx). (4.3) 

JR d 

It suffices to verify (|4.3[) for continuous function only. The general statement 
is obtained by a monotonic type approximation. 

For notational convenience, write and X^, if Xq = x and Xq is dis- 
tributed in the accordance with v. Making use Assumption 12.11 we find 
that 

\Xl-Xl\< Q \Xl_ x -Xl_ x \, n>l 

and claim that \X^ — X%\ converges to zero exponentially fast as long as 
n — > oo. For any x £ M. d , the latter provides 

lim Eg(X*,) = / g(x)n(dx). 

n'-*oo J R d 

This and the fact that (X n ) n >Q is the homogeneous Markov chain also imply 



lim Eg(X% +1 ) = / g(z)fi(dz). 



On the other hand, taking into the consideration Eg(X^, +1 ) = EPx x ,g, the 
above relation is nothing but lim EPx x g = f^d g(z)[i(dz). The next key 

n'— >oo n> 

tool in the proof is the Feller property: for any bounded and continuous g, 
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the function P x g = Eg(f(x,£\)) is the continuous as well. So, by the Feller 

property lim EP x *.g = L d Px9n{dx). 

n — >o o n 

Thus, JOJ) holds. 

Assume \J is another invariant probability measure, // 7^ /i. Then taking 
two random vectors Xq and Xq , distributed in the accordance to [i and \j! 
respectively and independent of (£ n )n>i> we create two stationary Markov 
chains (Xn) and (Xn ) defined on the same probability space as: 

xz = f{x£_ 1 ,z n ) 
x£ = f(x£_ x ,u)- 

By Assumption E31 \XH-Xit'\< q\X» - X%' | , i.e. lim \Xft-X(t'\=0 

n — >oo 

what contradicts □ 

4.2. The verification of (1). Let K be the Lipschitz constant for H. Then 
\H(x)\ < \H(0)\+K\x\ and f Rd \H(z)\/j(dz) < 00. Hence, is the correct 
assumption and for the stationary Markov chain X% we have EH(Xn) = 0. 
Then, 

\EH(XZ)\ = \E(H(XZ)-H(X£)\ 

< Kg n E\x - X!*\ < K(l + \x\)g n . 

Therefore, X^n>i \EH(X%\ < ^-(l + \x\). Consequently, the function U(x), 
given in (|3.1j) . is well defined and solves the Poisson equation. 
Recall that & = U(Xi) - Px^JJ- 

Lemma 4.2. The function U(x) possesses the following properties: 

1) U(x) is Lipschitz continuous; 

2) P X {UU*) — P X U{P X U)* is bounded and Lipschitz continuous; 

3) For sufficiently small 5 > and any i > 1 

E(\U(X i )-P Xi _ i U\ 3 e mXi) - P *-i < ~nst. 



Proof. 1) Since by Assumption l2.il 

l^n "^n I < f?|-^n-l ~~ -^"n-ll; 1^0 ~~ -^0 I ^ \ x> ~ x "\i 

we have 

\U{x>) - U(x")\ < \H(x>) - H(x")\ +J2E\H(XZ') ~ H(Xf)\ 



n>l 



<r K I ' "I 
< \x — x 



2) Recall (see JHSJ) 

P X (UU*)-P X U(P X U)* =B{x) 



(4.4) 



and denote B pq (x), p,q = 1, . . . ,d the entries of matrix G(x). Also, denote 
by U p (x), p = 1, . . . , d the entries of U (x). Since -B(x) is nonnegative definite 
matrix, it suffices to show only that Bp p (x)'s are bounded functions. Denote 
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F(z) the distribution function of £1. Taking into the consideration (|4.4|) and 
Assumption 12 .11 we get 

B pp (x) = E(u p {f(x,£ 1 ))- [ U p (f{x,z))dF(z)' 



<^Le f \^-z\dF(z) 2 <4^%E\^<oc. 



(1 - Qf 

The Lipschitz continuity of B pq {x) is proved similarly. Write 
B pq (x') — B pq (x") =: ab — cd, 



where 



E(u p (f(x'^i))- I U q {f(x',z))dF(z) 

v JR d 

E(u q (nx',^)) - [ U q {f(x',z)dF(z)) 

\ ./rod / 



c = E(u p {f(x",Ci)) - [ U q {f(x",z))dF(z 
d = E(u q (f(x",t 1 ))- [ U g (f(x",z))dF(zj) 



Now, applying ab — cd = a(b — d) + d(a — c) and taking into account Q4.4JI 
and Assumption 12. 11 we find that \a\, \d\ < j=j;E\£i\ and so 

\B pq (x') - B pq (x")\ < ^^EU\x' - x"\. 
3) By (jHU) and Assumption O 

Kf 

\u(x l )-p x ^ 1 u\< T —(m 1 \ + \^\). 

□ 

4.3. The verification of (2). The properties of G(x) to be bounded and 
Lipschitz continuous provide the same properties for 

h(x) = (A, [B(x) - B] A). 

Hence (2) is provided by (1). 

4.4. The verification of (3). Since U and u are Lipschitz continuous, they 
possess the linear growth condition, e.g. |J7(x)| < C(l + \x\), 3C > 0. So, 
(3) is reduced to the verification of 

lim -l—logp(\X n \ > en a ) = -oo, e > 0. (4.5) 
Due to Assumption 12. 11 we have 

\x n \ < |/(x„_i,&0| < |/(o,e n )| + e |x n _i| 

< i/(o, o)i + ^ n _ 1 |+€ie n |. 



12 B. DELYON, A. JUDITSKY, AND Ft. LIPTSER 

Iterating this inequality with Xq = x we obtain 

n n 

\x n \ < Q n \x\ + |/(o, o)| Q n ~° + * E e^lCj 

3=1 3=1 
H 3=0 



Hence, (|5.2[) is reduced to 

- n— 1 

lim T logP(j^^|e„-il > « a e) = -oo. (4.6) 

3=0 



n— *oo n^ a 



We verify (|4,6|) with the help of Chernoff 's inequality: with 5, involving in 
Assumption 12.21 and 7 = j^— 



Q 



3=0 

The i.i.d. property for £j's provides 

Se E"=o7^l^-il = Ee L?Zt 7^ la I < £ e E~ 7e*ldl = £ e «|6| < ^ 
and we get 

loggia I 



^logPfV^I^I > n a e) < -n 1 " Q fe + 



n 2a-i IS "- JI =" V " ' n 2 "" 1 n-^ °°' 

5=0 

5. The proof of Theorem 12.21 

The proof of this theorem differs from the proof of Theorem 12.11 only in 
some details concerning to (L.l). So, only these parts of the proof are given 
below. 

5.1. Ergodic property and invariant measure. Introduce (£ n )n>i the 
independent copy of (£ n )n>i- Owing to 



n-1 

n—ii 



X n = A n x + Y, A n ~% = A n x + Y, A l C 

i=l i=0 

we introduce 

n-1 

X n = A n x + ^A% (5.1) 

i=0 

and notice that the i.i.d. property of (£i)i>i provides (X n ) n >o l = (X n ) n >Q. 
By Assumption 12.31 A n — > 0, n — > 00, exponentially fast. Particularly, 

00 

^ trace (^cov(ei,6)(^T) < 00, 

i=0 

so that lim X n = a-s. and in L 2 norm. 



MODERATE DEVIATION PRINCIPLE 



13 



Thus, the invariant measure \i is generated by the distribution function 

~ _ oo 

of Xoo. In addition, -EH^H 2 = £ trace cov(fi, fi) (>!*)*) > so that 

i=o 

||z|| 2 //(cfe) < oo. 

5.2. The verification of (1) and (2). Due to 

we have (X^' — X^") = A n (x' — x"). Let us transform the matrix A into a 
Jordan form A = TJT^ 1 and notice that A n = TJ n T~ l . It is well known 
that the maximal absolute value of entries of J n is n|A| n , where |A| is the 
maximal absolute value among eigenvalues of A. By Assumption [2~^l |A| < 1. 
So, there exist K > and g < 1 such that |A| < g. Then, entries A™ of A n 
are evaluated as: \A™ \ < Kg". Hence, \X% — X%"\ < Kg n \x' — x"\, n > 1, 
and the verification of (1), (2) is in the framework of Section [21 

5.3. The verification of (3). As in Section |3J the verification of this prop- 
erty is reduced to 

lim -^—r\ogP(\X n \ > en a ) = -oo, e > 0. (5.2) 

n— >oo n 1 V / 

In (j5.2j) . we may replace X n by its copy X n defined in (j5,lj) . Notice also 
that 

oo 



\X n \ < Kx| + ^max|4 9 ||£|. 



i=0 



As was mentioned above, \A l pq \ < Kg 1 for some K > and £ £ (0, 1). Hence, 
it suffices to verify 



oo 



lim 

n— >oo n za 

i=0 

what be going on similarly to corresponding part of the proof in Section |H1 

6. Exotic example 

Let (AT n ) n >o, X n G R and Xq = x, be Markov chain defined by the 
recurrent equation 

X i 

X n = X n _ x ~ m n ~ + £ n (6.1) 
|^-n-l| 

where m is a positive parameter, (£ n ) is i.i.d. sequence of zero mean random 
variables with 

Ee 5 ^ < oo, for some 5 > 0, 

and let § = 0. 

Although the virtual scenario is not completely verifiable here we show 
that for 

H{x) = ^~ 
\x\ 
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the family (5") n >i possesses the MDP provided that 

m > \logEe 81 ^. (6.2) 
o 

Indeed, by (|6.1j) we have 

1 y-> X k _i = 1 (X n - x) J_y^ §k 

k=i l K 11 k=l 

n 

The family ^ m) >i P ossesses the MDP with the rate of speed n _ ( 2a_1 ) 
n k=i m n ~ 

and the rate function I(y) = -^kriy 1 ■ Then, the family (<S") n >i obeys the 
same MDP provided that ( x "a x ) n >i is exponentially negligible family with 
the rate re _ ( 2a_1 ). This verification is reduced to 

lim \ogP(\X n \ > n a e) = -co, e > 0. (6.3) 

By the Chernoff inequality P(\X n \ > n a e) < e~ Sna£ Ee 5 \ Xn \ that is (IO) 
holds if sup 

Ee s\x n \ 

< oo for some 5 > 0. We show that the latter holds true 

n>l 

for (5 involved in (|6.2j) . A helpful tool for this verification is the inequality 

\z — mAl < I \z\ — ml. Write 
I |z| I — 1 1 i I 

Ee s\x„\ = Ee^lQXn-x] <m) + Ee 5lXnl I{\X n ^\ > m) 

< e Sm Ee 5 ^ + e- 5m Ee s ^Ee slXn - 11 . 

Set I = e 5m Ee 5 ^ and q = e~ 5m Ee s ^. By @2J, e < 1- Hence, V(x) = e 5 ^ 
is the Lyapunov function: P X V < qV(x) + £. Consequently, 

EV(X n ) < Q EV(X n )+£, n> 1 

and so, sup^ £y(X n ) < V(x) + 

Appendix A. Exponentially integrable martingale-differences 
Let Cn = (Cn)n>i be a martingale-difference with respect to some filtration 

n 

& = (^n)n>o and M n = ^ be the corresponding martingale. 

i=l 

Theorem A.l. Assume that for sufficiently small positive 5 and any i > 1 

£(e 5|Cl| |J^_i) < const. (A.l) 

Then for any a G (0.5, 1) 

lim log I P(\M n \ > ne) = -co. 

Proof. It suffices to prove lim 2 i-i logP( db M' > ne) = -co and, more- 

n— >oo n / 

over, it suffices to verify "+" only ("-" is verified similarly). 

For fixed positive A and sufficiently large n, let us introduce the stochastic 
exponential 

n 

( f„(A) = n^(e A "|^-i)- 

i=l 
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A direct verification shows that 

'XM n 



£exp(^-log^(A))=l. 
We apply this equality for further ones 



1 > El(M n > nej exp (-^ - log^ n (A) 



(A.2) 



> EI[M n > nej exp I^Xe - log S n {\) ) . 
Due to S(A^|^_i) = and (TOT) , we find that 

log^,(A) = log (l + E[e x ^ - 1 - X^i-i 

i=l 

<K \— — 

~ I2n 6n 2 J' 

where K is some constant. This inequality, being incorporated into (|A.2|) . 
provides 

/ rA 2 A 3 

1 > El(M n > ne) exp (Xe-K — + — , 
7 V Lin on^ 

If eo < 3, taking A = e§nK~ x , we find that 

s e 2 n 2 ^ /l e 



^ log P{M n >ne) < 



-> — oo. 



n 2a-l-o- V""' -/- ^ V2 6^ n-»oo 

Hence, for any verification e > the desired statement holds true. □ 
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